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[Claims] 

[Claim 1] A nighttime vehicle recognition device that is installed in a vehicle and that detects other vehicles at night, 
provided with * h 

an image-capturing means that captures the image ahead of the aforementioned vehicle when it is moving, as horizontal 
and vertical two-dimensional brightness information by dividing it into predetermined pixels and by detecting the 
brightness of each pixel; ° 

a light source extraction means that generates binary images based on the brightness information captured by said 
image-capturing means; 

an image storage area for storing the aforementioned binary images; 

an image storage means for storing the aforementioned binary images in the aforementioned image storage area; and 

a vehicle recognition means that examines the behavior of each light source and determines whether or not said each 
light source belongs to another vehicle, by comparing the aforementioned two binary images stored in the 
aforementioned image storage area by the aforementioned image storage means at different times while the vehicle is 
moving. 

[Claim 2] A nighttime vehicle recognition device according to Claim 1 , further provided with 

a measurement means that computes the horizontal-direction length and vertical-direction length, inside the image, of 
each light source extracted by the aforementioned light source extraction means; 

a light source pair generation means that extracts two light sources whose horizontal-direction length and vertical- 
direction length, computed by said measurement means, are approximately equal, as a light source pair; and 
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a computation means that computes the distance in the imaee of the twn liohf 

and/or the slope in the image, of the line segment 2 ? " L n r u? "mpns.ng the light source pair 

extracted by said lightsouree pairgenS m«e«ta 8 ^ ""^ "* ° f ,he light sourct >™ 

the aforementioned vehicle recognition means 

-^n^ and slope computed by the 

determines whether or not said light sou rce JtE^SZt * 8 T"* Pa ' r gCneration means - and 
or not matching can be established. ? S ° m " ght S ° UrCeS 0n another vehic,e de Pe»ding on whether 

(Claim 3] A nighttime vehicle recognition device according to Claim 2 wherein 
the aforementioned light source pair generation means 

^^!Z^J^ZZ^^Z^T ned ligh, sources, and next b y 

light source to said first light source a^^^^^^ «g said second 

to said first light source is within the wlueZT***!^* . * • ^ d,st ? nce ^^'econdlBht source 
lengmmeasure^bymeaforem^i^ 

[Claim 4] A nighttime vehicle recognition device according to Claim 2 or 3 wherein 
the aforementioned vehicle recognition means 

treats the mid-position between the two light sources comprising the light source pair as the position of said light source 

soL U rcomS^rr h K, Vin8 ** ^ ant ! hon ' 20ntal sizes ** C0 ""P»" d » the distance between the two light 
Tag^^ 

uses only the binary images inside the aforementioned rectangular area when comparing the aforementioned two binary 
images in order to examine the behavior of the aforementioned light source pair. 

[Claim 5] Any of the nighttime vehicle recognition devices according to Claims 2 through 4, further provided with 

an inter-yehicle distance computation means that computes the distance between said other vehicle and the vehicle on 
which said nighttime vehicle.recognition device is installed, based on the distance between the light sources in said light 
source pair computed by the aforementioned computation means, wherein 

the aforementioned vehicle recognition means determines 

whether or not the light source pair judged to be from light sources on another vehicle belongs to an oncoming vehicle 
or the preceding vehicle, based on the change in the inter-vehicle distance computed by the inter-vehicle distance 
computation means. 



InterLingua 

(3 1 0)792-363 6/Fax(3 10)792-3642 



E] 1 " 1 eXpUna " on of ,he Invention) 
[0002] 

veh.ce, and .hat detects an oncoming vehfcl ££? ft?? ^7f,. e,emen,S anan «« i horizontally on the from of a 
,nd,v,dua. light-receiving elements. ^i^dS^SS^"" 0 "* * e a ™"<" "flight dete«X *e 
receivrng element that is squarely facing the otLr veh icSeadlh, WM * COmeS closer - «£ 

hand, those light-receiving elements that are ftatoZl « r ? ^ 3 large amount oflighr. On the ofher 
s,ce they have larger angles ^T*J!^j21&tt *™? S « n ^ £ I 
he amounts of l.ght detected by the individual liSS^f!^ *"* Substan,ial variabilfty amoVg 

reccve the l.ght from the vehicle's own headli^ BtaS Whe " "•*«»WW elemems 

[0003J 

-cognizing streetlights, etc. as 2r v2ic£ „ JST*^ ^ e <°- ESI! J 

-gn.eme .ightemittedhyothervehic.es 

[0004] 

f *« P-nt invention developed m order to 
vehic.es at night, provided with ^^SSSS^^. ^ h 8 "** 8nd ^ 
when i, is moving, as horizontal and vertiX^iSnafh^ * e , Bna 8 e . ahe8d °™« aforementioned vehlck 
p«eb and by detecting the brightness of ^15^2?™'^^'^^^ 
on the br.gh.ness infoonation captured by ™ ** S^"*" ^ «»*« 

aforementioned binary images; an imaee storaw S ™ ? m ,ma6e stora S e area for storing the 
aforementioned image storage^ and fvehS T ^ "* aforem ««ioned binary images in the 

anddetermmeswheLrorno ^eacMS SiS^Z? * ^ ^ 

binary images stored in the aforemembnri^ 

tunes while the vehicle is moving. 6 6 y aforementloned ""age storage means at different 

Sd^;rm^ 

the image, of each light source JSfflStT length and vertical-direction length, inside 
generation means thai extracts twTlieht ZmL S ? I " ,, 8 h ]. souree ex W«™ means; a light source pair 
computed by said measurcm^mm^te^rcxLlr hot ?° ntal ?*<*™ and vertical-direction lengd, 

computes the distance inTe taTrf £ ^ ' 85 ? ,6ht k S0 " re ' ! »nd a computation means iha 
image, of the line *vm!S££££™ ^TTf * " f ^ 8nd/ ° r 11,6 sIo P e in *« 
source pair generation am^SS^lL Z ""t^*' ^*°>^ Pa* extracted by said light 

SSL S S S0UrCCS ° n an ° ther VChiCle depCnding on whether or not matc ^ng can be 
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52"!US^ **» —« » 0- 2 wherein 

oftheaforementionedlightsoureesid™ ' by ^^^0 dTh? '° ned " y fet ™i"S °"e 

slope of the line segment connecting said 2XX£ ^bXTT Sa,,5fieS ' he COnditions ,hat * e 
also that the distance from said second light sS SK ^ u™.* W™™"'* horizontal and 
vertical-direction length or horfeonta dS onTng* m£S v heT " T" f V3 ' Ue ^ coms P onds '° *• 
light source. 0 aSUrCd by the aforementioned measurement area for said first 

comprising the light source pair as ^p^n^^Z^Jt^t^ f the ^ "' 8h ' sourc « 

and horizontal sizes ma. correspond toKnZnShfJ 3 re « r ar « having 'he vertical 
using the position of the lmht source nair 1^.7^ • ^ S ° UmS """P" 5 ^ 'aid light source pair, 

o^«o^ta.d«bdMiviorofte^ m ^SffiSr^ af0re ~ ned «*> binary images in 
[0009] 

[Operation and efFects of the invention] [n the nighttime vehicle recognition device described in Claim 1 an im»« 
captunng means captures the image ahead of the vehicle as vertical-horizontal tmJSSwSZ nfo™"Z" 

source extract™ means, and is stored tn an image storage area by an image storage means By comoarine two S 
bmary .mages that have been stored in this way, it is possible to determine whetheTTnot I brighten? £ 

wE^T^n ' beh8V ^- BaS6d °? C ° mpariSOn ~* "* vehicle ™cognhfon b m 8 eans^n fc£ 
whether or not the light source belongs to another vehicle. 

Kot^Ll 5 : b ?"?)5f Vehide rcc °S nition device described ^ Claim 1 takes in the brightness 

information that is ahead of the vehicle as vertical-horizontal 2-dimensionaI information, i.e., plane information it can 
recognize the position of the light source within that plane in both the horizontal and vertical directions In other words 
multiple light sources that would be interpreted by a device having light-receiving elements arranged horizontally as' 
being the same because their positions in the horizontal direction are identical, can be individually recognized because 
of the differences in their positions in the vertical direction. 

[001 1] Moreover, because the image storage means stores the aforementioned brightness information that has been 
converted into a binary image by the light source extraction means in the image storage area, positional changes in light 
sources can be examined by comparing two binary images that are stored at different times. By performing this 
examination, the vehicle recognition means can determine whether or not the light source belongs to a vehicle. For the 
determination method, a method such as that described below can be used, for example. 

[0012] That is, light sources that exist ahead of a vehicle mainly include the- headlights of oncoming vehicles, the tail 
lamps of the preceding vehicles, streetlights, etc. "Die speed of each of these light sources relative to a vehicle equipped 
with said nighttime vehicle recognition device when the vehicle is moving, is normally the greatest for the headlights of 
the oncoming vehicles, followed by streetlights and the tail lamps of the preceding vehicles, in that order, and 
consequently, the severity of their behaviors in the image also follows the same order. Therefore, by evaluating the 
severity of their behaviors, i.c, the magnitudes of positional changes In these light sources, these three types of light 
sources can be differentiated from each other. Furthermore, because the image-capturing means has taken in the image 
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individual light source can be differentiated fro* each ri JT» f ^ B ^ d ° n * hese sizes - 
. tatifiedtobethesa^be™^ 

[0013] In the nighttime vehicle recognition device descrihpH in ri a ;«, -> .u 

vem-caMirection.eng.handthehonzonmlXcl^ means c ° m P"<" 

source extraction means. Then, the light source pair ^IZ^Z^llSZ^H^ * ^ ligh ' 
the same values as the aforementioned computed values as a liaht source nair .n^. ■ ng a PP roximat «'y 

distance between the two light sources nmSS^X^SnJ^ com P utatlon ■»«» computes the 
s^eonnect^ten.olight^ ** " 8h, ^ "»» and ,he "°P< of the line 

^L^I^^^^^Z^^^f^. - binary images based on the 
by said light source pair general J^t^Z^^X^^ ^J??? 
sources on another vehicle depending on whether or not matching J^tSS ^ ^ ^ ^ m 

[00IS] That is, in the nighttime vehicle recognition device described in Claim 2 the lioht «„rr« «™h • .u • 

based on these distances and/or slopes, it is possible to detennine whej ?J £^££3 S K- 

[0016] During said matching attempt, using only the distances between light source pairs can prevent liaht source nairs 
havm* excessively long (or short) distances from being judged to be light source pairi belonging «o ^SSS^SS 
using on ly the slopes can prevent light source pairs having excessively large slopes from being judged to be light source 
pm belongmg to vehicles, Using both distance and slope can exclude all light source pairs exhibiting at least one of 
the aforementioned inappropriate values from the determination targets, thus improving the determination reliability. 

[00 1 7] Furthermore, in the nighttime vehicle recognition device described in Claim 3, the light source pair generation 
means extracts a light source pair by first extracting a light source, and next by searching a second light source using 
said first light source as the reference. Moreover, this search is performed under conditions that the slope of the line 
segment connecting said second light source to the light source being used as the reference is approximately horizontal 
and that the distance from said second light source to said first light source is within the value that corresponds to the 
vertical-direction length or horizontal-direction length measured by the aforementioned measurement area for said first 
light source. Therefore, those light sources for which the slope of the line segment connecting two light sources is too 
large for light sources belonging to a vehicle and for which the distance between two light sources Is too large for the 
light sources to belong to a vehicle compared to the sizes of the two light sources, are not extracted as light source pairs. 

[0018] That is, in the nighttime vehicle recognition device described in Claim 3, only those light sources satisfying the 
aforementioned conditions are extracted during light source search instead of searching for light sources from the entire 
image, and therefore those light sources that are inappropriate as light sources on vehicles are excluded, thus reducing 
the number of light source pairs to be extracted. Consequently, matching of light sources that is attempted between two 
binary screens after light source pairs have been extracted, can be performed more efficiently. 



InterLingua 

(3l0l792-3636/Fa.x(3l0)7</2-3642 
6 



eojrespond to the distance between, he tnM^SS^t^ ^ and horteontaI siz « <»»< 
other binary image, using the position of thf fZ ESTS ^ pair ' in ,he «™ P°™°" on the 
reference, and searches for a light source pair thafco^XoL-f of ^."^ntioned binary images as the 

SS-o^t 

^°- a ^-^^^^ 

stalled, i.e ,he so-called inter-vehic.e distance, bid on SStaS be^n'fh T! ^ reC0Sniti0n device * 
pa.r computed by the computation means. The change in Zt interTh?i 7? ! S0Urces in said '«»" «*■« 
determined for the light source pair judged to be fern if B h *T* bWWeen ^ """V «««« b «hen 

device, and whether or not that light source i Dair behZ SfS °" """^ Vehide * ,he recognition 

this distance is shrinking, the light ^ ource s ^uLe^Z r^'" 8 Veh ' C,e ° r ,he prWdin e Tha°, ?f 

change much, the lightsource isjudgedTo ^^^^^5^^ Veh '' e,e; " d * distanee do « °« 

25. fcnbed in C.ahn , the inter-vehicie 

.nusanoncommgvehiciec.bedi^ 

[0023] 

SSo^ to dmwmgs. Figure2 * a 

which menighnimevehicleLognitio^ 

vehicle hearts ,5,andac^ 

SJlfT 3 Sh0WS -' he ! nten,al ^"S"™" 0 " Of ECU 13. ECU 13 consists of a CPU 21 a CPU bus 23 a blna™ 
threshoW value generate circuit 25, a comparator 29 which converts an image signal 27 commeX, «mL 1 1 ^ 

whtch acts as the .mage storage area of die invention for storing binary images 3 x 3 filter ooeraZ f Uh3< £ 
extracung the outlmes of me binary images, 3 x 3 filter data ROM 37 ^storing me ^Sfi " x 3 fiE 

Ssor(D5)4i St ° rine * C Pr ° Sram ** f ° r B digiKil Signal pTOCeSSOr "" d • C 

{0026] Note that headlight switching signal 43 is sent to a headlight switching area (not shown in the figure) via CPU 
bus 23, and this signal is used for switching between the main beam and the low beam (see Figure 2). The processing 
performed by this device will be explained using the flow chart in Figure 4 and the diagram in Figure 5. Note that 
Figure 4 visually illustrates how a binary image stored in binary image memory 33 is processed. This process is started 
by a known timer interrupt with a predetermined time interval. 
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[0027] First, an image is input in Sten 601 in mhpr u,«~i 

Picture signal 27 in F?gure Atafffii K2SiS!?^'T ' ' 2 iS in P u ' - 

...putting picture signal 27 into the input &> on the no^tavX 7* " S,Cp 6 ° 2 - ** is "«omplished by 
p.cturesgnaU7byinpu„i„ g binary LsU 

nto the mverting side of comparator 29. and by florins this S!? I S """^ thresho,d value generation circuit 25 
■mage bus 3 i. That is, binary threshold value Z^Z^Ss Z Z'J^ ' m&Se memo V 33 v » 
extract™ means of the invention, and the si of ^ signals UnT ' C0, * Sp0nd *° *" 'W« sour <* 
proccssmg performed by the imagestorage mean's. tS^^^^ * ' he 

extract the outlines of the binary images based on the rL^TZ^T^ T ima S e m ™ory 33, and 
of the extracted binary imag« are stored in MM 39 6 S v a t ~ h , ^ * R ° M 3 * 71,6 images 
■mage 102 in Figure 5, and me bright areas i ^Le 101 afesuZlfh , 71,655 ° Ut,ine ima Ses arc shown as 
by outlines (i.e., the bright araasln image 101)1 d k at "hZIZ r * ° ' meS - Note areas surrounded 

vehides.street.ights.etc:. which wmhei'b^^ ^ «- of preceding 

stored in RAM39 for DSP. JASfflStK^?"?^^^^ 
computed. ^eseverticalandhorizontollengms^ 103 '« Figure 5 are 

means of the invention. Tnis is illus Jed in image 7 04 SjS * Pr ° CKS ' nS by 11,6 ^ S0Urce P**n«don 
[0031] Next, symmetry is tracked over two binary imaees in Stenfin* n,i«,,„» j 

to match light source pairs pertomed by the vehide Zt J\ « orTes P° nds » me.process of attempting 

based on the pairing data sWed^ RAM 39 for DSP in F 2t °h ^T"' ^ ™* " COm P U,ed * DSP «' 
which light). This is illustrated mtaa^ 105 inRgure J ( ' """^ ,isht is P aired U P wi * 

[0032] Next, distance computation is performed in Step 607. This is back-cafcularM f™, ,h„ . . « 

!S ^ h ^ d ! i8h,S ?? "T^ !n S,ep 6 ° 8 - If 11,6 a PP roximate imputed in Step 607 is equal to or 

K TlT? Va ' Ue C H? 100 m)l * e distance ,0 m oncomin S vehicle « P"c«4 vehiclSdged 
to be short, and the headlights ara switched from the main beam to the low beam, and the process is Wished 

p etai ' S 7 f TT? ^n" 0 " ta aforementioned Ste P 60S will be explained using the flow chart in 

tu£lf^r rm Z V ' SU ! y f^"® proCMSin8 COntent - Note in order 10 sin, P |if y *• explanation, 
light 49 (see Figure 7) only is used as the reference light, and the explanation will be limited to the process of searching 
for a light that forms a pair with light 49. 
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Lv J tl r» 7W °u ° f thC horjzontaWirec ^n length Lx (see Figure 7) or the vertical-direction length 

SttJS? I 2. T S ^"f^ * L In the succeedin ^ Sle P 702 > «■« horizontal direction of Z 2 
range for the light that forms a pair with light 49 is specified, and the width of the search range is set in correspondence 
to the value of the : aforementioned L. Here, this width is set to IOL by multiplying L by a proportional 
h £? :° th b0 * t S!dcs ri 0f ■«*» ^ light 49 as shown in Figured Note LESS S^mfi 

s defined as the intersection between the line bisecting the vertical-direction length of the light and the line b sec fna 
the horizontal-direction length of the light, and the position of each light is represented by this center position ° 

SSXi^ 703 ' Tr S i! *™ * de,e ™ ined °* e ' » specify the vertical direction of the search range for 
the light tha forms a pa.r with light 49. This angle area is selected so as to make the line segment connecting light 49 
w,th the paring light approximately horizontal, and is determined by specifying up and down angle uOmtSSSZ 

™ ITT W ' lh hght 49 ? ih f " mCr - HCre ' « Sh0W " in F * Ure 7 « " ^ *™ degrees up an" 
..e„ a total of 16 degrees are specified on both the left and right sides of light 49. Angle areas thusdetermLd and the 
search range specified in Step 702 produce two search ranges 51a and 51b (see Figure 7) consisting of triads 

[0037] Next, in Step 704, lights whose center positions arc located inside search ranges 51a and 5 lb are extracted 
Here, m Figure 7, hght 53 whose center position is located inside the search range of light 49 is extracted. When light 
53 has been extracted, the succeeding Step 705 checks each light's horizontal-direction size, i.e., the horizontal length 

length Lx of hght 49 and the horizontal length Lx' of light 53 (see Figure 7) should be nearly identical and therefore 

K ™^ 8 hIT ' WhethCr ,° r ? 0t * C P ™ h fr ° m Iight S0Urces on fl veh!cle ' Here ' Proportional constants 

KLrxmax and KLrxmtn are set up, and whether or not KLrxmax-Lx 2> Lx' ^ FCLrxmin-Lx is satisfied iTchecked. 

[0038] | Next, each light's vertical-direction size, i.e., the aforementioned vertical length, is checked in the same way in" 
Step 706. That is, for the vertical length Ly of light 49 and the vertical length Ly' of light 53 (see Figure 7) whether or 
not KLrymax-Ly 2s Ly' ;> KLryminLy is satisfied is checked (where KLrymax and KLrymin are proportional 
constants). 

[0039] Next, an other light presence prohibition area is set up in Step 707. If light 49 and iight 53 are a pair from light 
sources on a vehicle, a third light cannot be present between these two lights. Therefore, other light presence 
prohibition area 55 (see Figure 7) is set up, and if another light is present in this area, light 49 and light 53 are not 
considered a pair (Step 708). 

[0040] When all of the above check items have been satisfied, light 49 and light 53 are extracted (in Step 709) as a 
candidate pair from light sources on the same vehicle (hereafter simply referred to as "pair of lights"), and said 
symmetry extraction process is terminated. Next, the details of the symmetry tracking in the aforementioned Step 606 
will be explained according to the flow chart in Figure 8 and Figure 9 which visually illustrates the processing content 
Note that symmetry tracking means the examination of where the pair of lights extracted in the aforementioned Step 
605 have moved to in the next image 59 (see Figure 9). The next image 59 is a binary image that is obtained by 
performing the same processes as in the aforementioned Steps 601 through 603, and that is delayed by the amount of 
time required for the above-listed processes, from the current image 57 (see Figure 9) from which symmetry was 
extracted. 

[004 1] First, to quantify the characteristics of the pair of lights that have been extracted, distance W between the center 
positions of the two lights on the screen (see Figure 9) and the angle 0 formed by the horizontal line and the line 
segment connecting the center positions (see Figure 9) are computed (Step 801). The vertical-direction length and the 
horizontal-direction length that have already been measured in the aforementioned Step 604 are also used as quantities 
indicating the characteristics of this pair. Hereafter, for the lights comprising this pair, the horizontal- and vertical- 
direction lengths of the right-side light will be denoted as Lrx and Lry, respectively, and the horizontal- and vertical- 
direction lengths of the left-side light will be denoted as Llx and Lly, respectively (see Figure 9 for all). In other words, 
the processing performed in Step 801 corresponds to the processing performed by the computation means of the 
invention. 
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of lights. If «ha« pair is a light sourc 5r ^ wSr " 2 W ^ ^ ^ f 0 "^ t0 the ex,rae * d P^r 
Therefore, using a pmportional constant o ^ Si altotL J* ^7 Sh ° U ' d m ° Ve h the next ima Se 59. 
Center and is specified asm^^^^^^^^ 

as the vertical-direction search range on the next ima'e ST2,S£S£ T ( *' ? 35 ' he CCnter and is s P ecified 
corrected by taking up-down and left-right mSwSta J!S ^ P «i ^ h ,he ne *' ima S e 59 « 

is presumed that pitching and ^5?™^^*^ Mmera 11 Counted on a vehicle, it 
image. Therefore, by denoting the^p-doS M^fZZnJtT™ ' he SCreen for Mch 

respectively, Kx"-W + Ax and KV-WAv wJT .„ 1 "r T m ° vements of 8 P 3 " within the image as Ay and Ax 
vertical-dirlaion search Lge ^TSSLltS hori^.-direction search range anS the £ 

specif in S Kps8 0 2 ,rough 804 ^ P ,LS^ 

K^aSX^pi^i^ between two fights is positioned in 

inside search nmg. tf| is exited Z * Ze^dTn ^ whosemid -P<**k '"ated at coordinates (X". /) 
exacted (Step g 0 S 6). Bat is. uiing S^SSt ^7^0^"^ ~ 

™. aX r a f d [ or «* h °nzonta! direction, whether or not KLrxmax-Lrx * Lrx" * KUxmuvLrx is safefedfc 

checked. Likewise, whether or not the vertical-direction Is within the tolerance is also checked. 

[0046] Next, .he size of the left light is checked in Step 808. This is based on the same concept as that used for 
checking the size of the nght light; and for the vertical direction, proportional constants KLrymax and KLrymin are set 
up, and whether or not KLrymax-Lry 2 Lry 1 * KLrymin-Lry is satisfied is checked. Likewise, whether or not the 
horizontal direction is within the tolerance is also checked. 

[0047] Furthermore, the slope of the pair is checked in Step 809. If the pair extracted in the next image 59 and having 
its mid-point at (x\ y 1 ) is what the pair extracted in the current image 57 and having its mid-point at (x, y) becomes after 
a move, the slope of the pair should not change abruptly. Therefore, by setting up proportional constants K9max and 
K9min, whether or not KSmax O £ 6' £ KBrnin G is satisfied is checked 
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[0048) A pair that satisfies all the checks in Stem JtfV7 thm.mk © ao * ■ 

same vehicle (Step 810), and .his ^ , 21^ ^ " " 2*2 ^ S0Urces Mm ™ <° »>< 
switching headlight 15 according o J^SteLTr 4 ^ '° Sh0WS n exm * ° r 
shows the process in which the ^igfJ^JX^^^^ *T " ' hr ° USh * ™ n S ure 
approaching, are .witched to the main beam ^h^^^L^^V^ ? ° nCOmi " S Vehicle 
vehicle is detected again and its distance from the vehide S . m a "? ° ns " *V Kte * and when an oncoming 
approximately 170 meter,, the fc-^S^f^S^lE* reC ° Sm,i ° n ^ " M 

computed in Step 604. The sizes of lights LcL™!^ ! \ , r PP """S 35 bnsht spots on ,his ima Se can be 
connected to said fight also happens to beVximate.^ 

S !rr m ,? a pai ; of u ,ights - 85 a resu,t - Even * such * «*■ *<= «s"< eSTts^S " Z££ 

different from those of other vehicles' lights, and thus will not be regarded as a light from another veMele Zrt 
of a completely different behavior is provided below. For example, a pair of lights fa^SSL «3S 

1™- 5 , 83 W6 J • ,? ' 0ntraSt • 3 S,reetIight fa m0vin S 81 a difrerent rel «ive speed from a vehicle, and th "the 
Ln TexcS ^ 8 ^ taCrcaSeS - °«Wly. *• streetlight will be caughtby the check in tap m 2 

Snrll^i 0 / li8ht SWK - 'T to * C ^ taage 59 » ^ ° Ut by M ^ for * e mid -P oi ™ ««* lights 
comprising a hght source pair. Stnce search range 61 is set up also for this search, tracking can be performed 
efficiently. That is, search range 61 is defined in the horizontal and vertical directions In St? 8oVW 803 
respectively, in correspondence to distance W between the two light sources comprising the light source pair, and 
therefore, the allowable movement range in the next image 59 can be set up according to the size of the light source 
pair. Consequently, those light source pairs that move too far can be excluded from search targets. 

[0055) Moreover, since left-right movements Ax and up-down movements Ay caused by pitching and rolling of 
vehicle 3 have been incorporated into this search ranges 61. searching can be performed even if vehicle 3 rocks. That 
is, headlight angle automatic switching device 1 determines whether or not lights belong to other vehicles based on the 
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sizes of the lights ahead of vehicle 3, the distance between two lights, whether or not the line seem-nt , n n„^« .k 
two lights is horizontal, as well as the behaviors of the two lights inside images X i 
streetlights, decorative lights, etc. and does not cause headlights 15 to be switched too frequwtly 

K« An h eX f lanatl ° n Pr0vlded ab0VC for hcad,i S ht ™& automatic switching device 1 to which the 

TV? l ° thC inVemi ° n h2S bCCn a PP lied H <~> ^ Mention is not L ed 

nvlnHo PP , u ^~^d,^mp^ and can be implemented in various formats. For exampte me 
invent on was applied to headlight angle automatic switching device I in the aforementioned working examplebui can 
also be apphed to a device that warns of an approaching oncoming vehicle. Uat is, it is possible to conS a devi« 

SinS? £r ~ WhCn " ° nC ° minS VChiCle iS detCCted Such a ^ ^^i£Z 

[0057] It is also possible to configure a device that detects the distance to the preceding vehicle and alerts the driver 

hV'h di r ce becomes to ° short Such a device ™" d «wS £S2r 

Furthermore if Wc is defined as the apparent width of the target pair on the screen (Llx/2) + W + (Lrx/2) the rate of 
change m Wc per unit time, dWc/dt, is proportional to the relative speed of the pair to the mage^Spo itTon of 
the camera. Therefore, if Kw is defined as the proportional constant determined by the n^fid^XT£ 
system.Kw.dWc/dt becomes 

be utilized by a nighttime vehicle speed measurement device. 

SSJ^^ t^T thn u W ° rkinS . eXam , P,C ; h W3S CXplained *"■*■ ncxt ima * e 59 is in P ut anew ■» <^der to track 
he lights that form a pair However, instead of using such a method, it is also possible to input the image using only 
he process that is equivalent to the aforementioned Step 601. In such a case, no symmetry tracking is performed for- 
the image that is input first, for example, and symmetry tracking can be performed for subsequent images by comparing 
them to the previously input image. ; F 6 

[0059] The processes in Steps 807 through 809 check the extracted pairs, and it is also possible to additionally check 
the distance between the light sources that comprise a pair. For example, by defining W as this distance and KWmax 
and KWmm as proportional constants, whether or not KWmax-W z W * KWrnin-W is satisfied is checked. Such a 
process will eliminate mistaken recognition of those light sources that satisfy the checks in Steps 807 through 809 but 
whose W is too wide to belong to light sources on a vehicle. 

{Brief explanation of drawings] 

[Figure I] A block diagram illustrating the nighttime vehicle recognition device according to the invention. 

[Figure 2] A schematic configuration diagram showing the overall configuration of a headlight angle automatic 
switching device 1 which is a working example of the invention. 

[Figure 3] A diagram illustrating the internal configuration of ECU 13 of the working example. 

[Figure 4] A flow chart illustrating the processes performed by ECU 13 of the working example. 

[Figure 5J« A diagram visually showing how the binary image stored in binary image memory 33 is changed by the 
processing performed by ECU 13 of the working example. 

[Figure 6] A flow chart illustrating the light symmetry extraction process in the working example. 

[Figure 7] A diagram explaining the symmetry extraction process in the working example. 
[Figure 8] A flow chart illustrating the symmetry tracking process in the working example. 

[Figure 9] A diagram explaining the symmetry tracking process in the working example. 
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(Explanation of symbols) 

I . .. Headlight angle automatic switching device 
3 ... Vehicle 

5 ... Image ahead 

II . .. Camera 
13 ... ECU 
15... Headlights 
21 ... CPU 

33 ... Binary Image memory 
49 ... Reference light 
51a, 51b ... Search ranges 
53 ... Light that has been found 
55 ... Presence prohibition area 
57 ... Current image 
59 ... Next image 
61 ... Search range 
101 -106... Images 



[Figure 1] 1 

#1 (mage-capturing means 

#2 Light source extraction means 

#3 Image storage means 

#4 Image storage area 

#5 Vehicle recognition means 



[Figure 2] 
#1 Camera 11 
#2 Vehicle 3 
#3 Headlights 15 
#4 Main beam 
#5 Low beam 

#6 Nighttime image ahead of vehicle 5 



[Figure 7] 

#1 Other light presence prohibition area 55 



1 IL Note - Please refer to numbered original for all figure legends. 
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(Figure 3] 

#1 Headlight-switching signal 
#2 CPU bus 

#3 Binary threshold value generation circuit 

#4 3x3filteroperation LSIs 

#5 3x3 filter data ROM 

#6 RAM for DSP 

#7 Binary threshold value signal 

#8 Comparator 

#9 Image signal 

#10 Binary image signal 

#11 Image bus 

#12 Binary image memory 

[Figure 5] 

#1 Binary conversion 
#2 Outline extraction 
#3 Light size computation 
#3b 

Horizontal length 

Vertical length 

#4 Symmetry extraction 

#5 

Symme?7 tracking 

a. Preceding vehicle 2 

b. Oncoming vehicle 2 
c Preceding vehicle 1 
d. Oncoming vehicle 1 
#6 

Computation of distance to the vehicle 

a. Computes distance based on the width of the pair. 
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[Figure 4] 

(START) 
I 

[Inputs an image.] -601 
I 

[Converts the input image into binary data.] - 602 

[Extracts the outline of the image that has been converted into binary data J - 603 

[Computes light size.] - 604 
I 

[Extracts light symmetry.] - 605 
I 

[Tracks symmetry.] - 606 
I 

[Computes distance.] - 607 
I 

(Switches headlights.] - 608 



[Figure 6] 

(START) 
I 

[Uses the larger of the horizontal-direction length Lx or the vertical-direction length Ly of the light as L] - 701 

[Sets the horizontal-direction search range to a value proportional to L. (Horizontal-direction search ranee = 
K.L)]-702 
I 

[Sets the vertical-direction search range to a certain value (e.g., 1 6 degrees)] - 703 



(Extracts lights whose center positions are located inside the search range.] - 704 
I 

[Checks the horizontal-direction size. (KLxmax-Lx s Lx* £ KLxmin Lx ] - 705 
I 

[Checks the vertical-direction size. (Klymax-Ly z Ly' 2s KLymin-Ly ] - 706 
I 

[Sets up other light presence prohibition area.] - 707 
I 

[Checks whether or not the center point is located in the presence prohibition area.] - 708 
I 

[Extracts as a pair of lights.] - 709 



(STOP) 
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[Figure 10] 

#1 Distance to the vehicle [m] 

#2 Headlight 

#3 Low beam 

#4 Main beam • 

#5 Low beam 

#6 Preceding vehicle 

#7 Oncoming vehicle 

#8 Oncoming vehicle 

#9 Oncoming vehicle 

#10 Oncoming vehicle 

Time [sj 



[Figure 8] 

(START) 
I 

[Extracts the characteristics of a pair.] - 801 



[Computes the horizontal-direction search range in the next screen. Kx'-Vv] - 802 
[Computes the vertical-direction search range in the next screen. KyM/v] - 803 

£SS£ W^ifi&Sr by takbS ^ and ^ -vements * 

ScS?n% P 5 alr ^ ^ SCre9n ' Wh ° Se Cent6r P ° Siti0n ,s ,ocated ^e search range in the next 
I 

[Extracts the characteristics of the pair whose center position is located inside the search range. ] - 806 

[Checks the size of the right light. KLrxmax-Lrx ;> LrV ;> KLrxmin-Lrx ] - 807 

(Checks the size of the left light KLry max-Lry > Lry' i> KLrymin-Lry] - 808 

[Checks the slope of the pair. KGmax-e ^ 9' ;> KGmin e] - 809 

[Selects a pair in the next screen.] - 81 0 
I 

(STOP) 
[Figure 9] 

dx: Left-right movements 
Up-down movements 
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r . H. ftffl fondo _, hereby declare that I am a professional 
translator experienced in translating patents and technical publications, and 

fore S° m S 'S a true and accurate translation of Japanese patent Hei 8- 
166221 to the best of my knowledge. 



